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ABSTRACT 

We present a comparison of two methods for cosmological parameter inference from super- 
novae la lightcurves fitted with the SALT-II technique. The standard chi-square methodology 
and the recently proposed Bayesian hierarchical method (BHM) are each applied to identi- 
cal sets of simulations based on the 3-year data release from the Supernova Legacy Survey 
(SNLS3), and also data from the Sloan Digital Sky Survey (SDSS), the Low Redshift sample 
and the Hubble Space Telescope (HST), assuming a concordance ACDM cosmology. For both 
methods, we find that the recovered values of the cosmological parameters, and the global nui- 
sance parameters controlling the stretch and colour corrections to the supernovae lightcurves, 
suffer from small biasses. The magnitude of the biasses is similar in both cases, with the 
BHM yielding slightly more accurate results, in particular for cosmological parameters when 
applied to just the SNLS3 single survey data sets. Most notably, in this case, the biasses in the 
recovered matter density Sl nl are in opposite directions for the two methods. For any given 
realisation of the SNLS3-type data, this can result in a ~ 2a discrepancy in the estimated 
value of Q, m> o between the two methods, which we find to be the case for real SNLS3 data. 
As more higher and lower redshift SNIa samples are included, however, the cosmological 
parameter estimates of the two methods converge. 

Key words: methods: data analysis - methods: statistical - supernovae: general - cosmology: 
miscellaneous 



1 INTRODUCTION 

It has long been recognised that astronomical standard candles are 
of great value in constraining cosmological models. The basic ar- 
gument is very straightforward. The luminosity distance Dl to an 
object of absolute luminosity L, from which one measures the flux 
F, is given b)Q 

C-U" 2 . 



(1) 



Thus the distance modulus fj, — m — M between the apparent mag- 
nitude m = —2.5 log 10 F of the object and its absolute magnitude 
M is given by 



^ 5iog -G^) +25 ' 



(2) 



where the constant offset ensures the usual convention that /j, — 
at D h = 10 pc. 

In a standard FRW cosmological model containing cold dark 
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1 For simplicity, we work for the moment in terms of bolometric quantities. 



matter and dark energy, defined by the usual cosmological param- 
eters ^ = {f2 m ,o, fido.o, Ho, w}, the luminosity distance to an 
object of redshift z is given by 



c (1 + z) 



fli 



S{y/\Sh~o\I{z)), 



(3) 



where 



/(*) = 



dz 



Id Vi 1 + 2) 3 «m,0 + (l + Z) 3 ( 1 + tu >n do , + (l + z) 2 fi ft , 

(4) 

in which (neglecting the present-day energy density in radiation) 
Qk,o = 1 — fim.o — f^dc.o an d S(x) — x, sinx or sinha; for a 
spatially-flat (flk,o = 0), closed (flk,o < 0) or open (flfc,o > 0) 
universe, respectively. The special case w = — 1 corresponds to a 
cosmological constant, for which one usually denotes the present- 
day density parameter by S7a,o- 

Thus, by measuring the distance moduli and redshifts of a set 
of objects (i = 1,2, ... , N) of known absolute magnitude (stan- 
dard candles), and considering the difference 

obs 



(5) 



between the observed and predicted distance modulus for each ob- 
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ject (often termed Hubble diagram residuals), one can place con- 
straints on the cosmological parameters c €. One should note, how- 
ever, that in the case where the standard candles share a common, 
but unknown, absolute magnitude M, this value is exactly degen- 
erate with the Hubble constant Ho, as is clear from {T]l and (3}. 

In practice, there are no perfect astronomical standard can- 
dles. Type-la supernovae (SNIa), for example, have absolute mag- 
nitudes that vary by about ±0.8 mag in the B-band due to phys- 
ical differences in how each supernova is triggered and also due 
to absorption by its host galaxy. Nonetheless, SNIa do constitute a 
set of 'standardizable' candles, since by applying small corrections 
to their absolute magnitudes, derived by fitting multi-wavelengths 
observations of their lightcurves, one can reduce the scatter con- 
siderably, to around ±0.15 mag in the B-band. In essence, SNIa 
with broader lightcurves and slower decline rates are intrinsically 
brighter than those with narrower lightcurves and fast decline rates 
( |Phillips|1993l|Hamuy et al.|1996| >. 

SNIa lightcurve fitting techniques fall into two categories: 
those that give a direct estimate of the distance modulus, such as 
the Multi Colour Light Curve Shape (MLCS) method ( |Jha et al.| 
|2007[ > and those that give estimates of the supernova apparent mag- 
nitude, lightcurve shape and colour, which can be translated into 
distance modulus via supernovae global parameters that must be in- 
ferred simultaneously with the cosmological parameters. This latter 
category of techniques includes lightcurve fitting methods, such as 
the Spectral Adaptive Lightcurve Template method, (SALT) ( |Guy| 
[eTaT1[20031 |Astier et al.||2006) , SALT-II ( |Guy et al.|[20TU> and 
SlFTO ( |Conley et al.|2008| >. It is this latter category of methods 
with which this paper is concerned, and in particular the SALT-II 
methodology. Another important difference between the two cate- 
gories of lightcurve fitter is that the former infers the SNIa distance 
moduli directly, which are then used to infer the cosmological pa- 
rameters, whereas the latter divides the process into two steps: first 
the lightcurves are fitted to obtain SNIa light curve parameters such 
as trig j , d , X\ i i which are then used to infer cosmological parame- 
ters simultaneously with the SNIa global parameters a, (3, Mq, in a 
second step. This therefore provides an opportunity to use the prod- 
ucts of the first step of the SALT-II analysis, namely the stretch, 
colour and absolute B-band magnitude (mg j, &i, xi,i) as the in- 
puts to alternative methods for inferring cosmological parameters. 

In this paper, we take advantage of this opportunity and per- 
form a comparison of cosmological inference methods using su- 
pernovae lightcurves fitted with SALT-II. In particular, we com- 
pare the standard x 2 -method which is widely used in the analysis 
of SNIa, and the Bayesian hierarchical methocJ^](BHM), which was 
recently proposed by March et al. (20fTJ. For varyin g implemen 



tations of the standard x -method, see for exa mple [ Astier et al. 
((2006); |Kowalski et~aiT| p008l >; |Kessler et aIT| ( |2009a| >T 



Amanul- 



Marriner 



lah et al.|<[20l0l >; |Guy et al.| l [2Tjl0} ; |Conley et al.|pOTT 
et al.|P01 1\. The comparison is performed by applying both meth- 



ods to sets of realistic simulated SN data based on the real 3-year 
data release from the Supernova Legacy Survey (SNLS3) ( |Conley| 
|et al.|20lTj|Guy et al.|20 l0), together with a compilation of various 
other samples at lower and higher redshift suggested and supplied 
by the SNLS3 team. We also apply both inference methods to the 
real SNLS3 single survey data set to compare the cosmological pa- 
rameter inferences obtained from the two approaches. 

The outline of this paper is as follows. In Section [2] we give 



2 A copy of the BHM code is available from the corresponding author on 
request. 



a short summary of SALT-II lightcurve fits, followed by a brief 
description of the standard x -method and BHM for inferring cos- 
mological parameters from SNIa lightcurves fitted with SALT-II. 
In Section [3] we describe the real SNLS3 data set along with the 
real SDSS, HST and LowZ samples on which our simulations are 
based, and then discuss our simulation process in Section [4] The 
statistical comparison of the x 2 - me thod and BHM, as applied to 
our simulated data sets, is described in Section [5] and the results 
of applying the two methods to the real data are presented in Sec- 
tion^ We conclude in Section|7] 

Finally, we note that this paper may be considered as comple- 
mentary to our companion paper (Karpenka et al. 2012), in which 
we use an extension of the BHM to constrain the properties of dark 
matter haloes of foreground galaxies along the lines-of-sight to (a 
subset of) the SNIa in the SNLS3 catalogue, assuming a fixed back- 
ground cosmology. 



2 COSMOLOGICAL INFERENCE METHODS 

Cosmological parameter inference takes place after the selection 
cuts, lightcurve fitting and Malmquist correction stages of the anal- 
ysis process have been implemented (see Section [3JI. The most 
widely used method for cosmological parameter inference from 
SALT-II fitted lightcurves is the basic minimization of the chi- 
square statistic, although there are a few differences in the way 
in which this method is implemented, as outlined below. More 
recently, |March et al.| J2011) proposed a Bayesian hierarchical 
method (BHM), which provides a robust statistical framework for 
the full propagation of systematic uncertainties to the final infer- 
ences. We give a brief outline of these two alternative approaches 
below, but note that in our subsequent analyses the SNIa data in- 
put to the two methods are the same, having had the same selection 
cuts, fits and corrections made. 

For each selected SNIa, in addition to an estimate z of its red- 
shift and an associated uncertainty a z , derived from observations 
of its host galaxy, we take as our basic data the output from the 
SALT-II lightcurve fitting method, which produces the best-fit val- 
ues: rh* B , the rest frame B-band apparent magnitude of the super- 
novae at maximum luminosity; Xi, the stretch parameter related to 
the width of the fitted light curve; and c, the colour excess in the 
B-band at maximum luminosity. These are supplemented by the 
covariance matrix of the uncertainties in the estimated lightcurve 
parameters, namely 



2 



/ a 2 m , B T m * B>xl a. 
n — 2 

Therefore, our basic input data for each SN (i = 1 

Di = {ziyiriB^yXi^jCi}, 



(6) 

, N S n) are 
(7) 



and we assume (as is implicitly the case throughout the SN lit- 
erature) that the vector of values (rh* B ah.i, £i) for each SN is 
distributed as a multivariate Gaussian about the true values, with 
covariance matrix Ci. 



2.1 Standard x 2 -method 

The standard method of cosmological parameter inference used 
with outputs from the SALT-II lightcurve fitter is a basic chi- 
square minimization technique, see for example | Astier et al.| 
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scription of some statistical issues associated with the methodol- 
ogy, is given in the preceding references; we therefore present only 
a brief summary here. 

One begins by defining the 'observed' distance modulus fi° hB 
for the ith SN as 



rh* B i — M + a&i,i — /3c., 



(8) 



where M is the (unknown) _3-band absolute magnitude of the 
SN, and a, ft are (unknown) nuisance parameters controlling the 
stretch and colour corrections; all three parameters are assumed to 
be global, i.e. the same for all SNIa. 

One then defines the \ 2 misfit function 



X 2 (^,a,/3,M,a lnt ) = 



[ M f>,/3,M)- M ,(^)] 2 

(T? (a, P, (Ji nt ) 



(9) 



where, for clarity, we have made explicit the functional dependen- 
cies of the various terms on (only) the parameters to be fitted. In 
this expression, pn is the predicted distance modulus given by |2| 
and is a function of SN redshift z, and the cosmological parameters 
and the total dispersion erf is the sum of several errors added in 
quadrature: 



+ fIt,i(Q!,/3). 



(10) 



The three components are: (i) the error a zA in the redshift mea- 
surement owing to uncertainties in the peculiar velocity of the host 
galaxy and in the spectroscopic measurements; (ii) the intrinsic dis- 
persion dint, which describes the global variation in the SNIa abso- 
lute magnitudes that remain after correction for stretch and colour; 
and (ii) the fitting error, which is given by 



2 



(11) 



where the transposed vector i/> = (1, a, —0) and Ci is the covari- 
ance matrix given in l|6j. 

Typically, the chi-squared function l|9j is minimized simul- 
taneously with respect to the cosmological parameters ^ and the 
global SNIa nuisance parameters a, j3 and M. There are, how- 
ever, a few differences in the way in which this minimisation is 
performed, such as which search algorithm is used (MCMC tech- 
niques or grid searches) and the treatment of M (which is degen- 
erate with Hq), namely whether these parameters are marginalised 
over analytically or numerically. Once this chi-squared minimisa- 
tion has been performed, the value of a mt is estimated by adjusting 
it to obtain x /Ndot ~ 1, usually by some iterative process. 

In this work, we take the simple_cos_fitter algorithrrP] |Con- 
|ley et al.|201 1| > as representative of the general class of chi-square 
methods, and compare its performance with the BHM, which we 
describe below. It should be noted that the chi-square method is an 
approximation to the BHM in certain limits (see |Gull| 1989| for a 
general discussion of this, and March et al.|2011| for a discussion of 
this as applied to the SNIa case.). Hence we expect the two meth- 
ods to converge in some limit; detailed studies into this exact limit 
have not yet been carried out. 



Recently, a more statistically well-motivated method for cosmolog- 
ical parameter inference from SNIa was put forward in the form of 
a Bayesian hierarchical model {March et al.|201l) , itself based on 
the methodology of (Gull|1989|, and indee d is a special case of the 
more general methodology of (Kelly 2007); which provides for full 
propagation of systematic uncertainties to the final inferences and 
also allows for rigorous model selection. 

In essence, this method provides a means for constructing a 
robust effective likelihood function that yields the probability of 
obtaining the observed data for the ith SN (i.e. the parameter values 
obtained in the S ALT-II lightcurve fits) as a function of the cosmo- 
logical parameters and global SNIa nuisance parameters, namely 



Pr(jfia it , Xi,i,Ci, Zi^g, a, /3, cr inC ), 



(12) 



which also depends on the covariance matrix d of the uncertainties 
on the input data (ro^ %, %i,i> Ci), and the uncertainty a z ,i in the 
estimated redshift Sj, all of which are assumed known. The full 
likelihood function is given by the product of the likelihoods l | 1 2[ i 
for each SN. 

The likelihood for each SN is computed by first introducing 
the hidden variables Mi, Xi, Ci and Zi, which are, respectively, the 
true (unknown) values of its absolute B-band magnitude, stretch 
and colour corrections, and redshift. These are then assigned pri- 
ors, which themselves contain further nuisance parameters, and all 
the parameters introduced in this way are marginalised over to ob- 
tain the likelihood l |12[ (. The details of this procedure are given in 
Appendix A. By assuming separable Gaussian priors on the hid- 
den variables and nuisance parameters, one can perform all the 
marginalisations analytically, except for two nuisance parameters 
R x and R c , which are also described in Appendix A, that must be 
marginalised over numerically. 

The full likelihood function is then multiplied by an assumed 
prior (see Appendix A) on the unknown parameters to yield their 
posterior distribution. This posterior is explored using the Multi- 
Nest algorithm ( |Feroz & Hobson|2008"l |Feroz et al.|2009), which 



2004) |2006l > 



implements the nested sampling method iSkilling 
adapted for potentially multimodal distributions. 



3 REAL SUPERNOVAE DATA 

We will perform our comparison of the standard chi-square method 
and the BHM by applying them to two classes of data sets. The 
first of these is the single survey SNLS3 data alone, i.e. only SNIa 
data which was taken during the first three years of the SNLS3 sur- 
vey ( |Guy et al.|2010) . We take the SNLS3 data as supplied by the 
SNLS3 tearrQ after selection cuts have been made, the SALT-II 
lightcurve fitting process has been completed and the Malmquist 
correction has been applied. Our interest in comparing the perfor- 
mance of the two cosmological parameter inference methods as ap- 
plied to this single survey data set is driven by potential science ap- 
plications that use a single SNIa survey in conjunction with other 
data sets (not SNIa) to investigate various astrophysical and cos- 
mological phenomena. An example of such an application is con- 
straining the properties of dark matter haloes of foreground galax- 
ies along the lines-of-sight to the SNIa using gravitational lensing, 
as discussed in our companion paper (Karpenka et. al. 2012). 



3 Alex Conley's simple_cos_fitter code has generously been made available 4 SNLS3 data and associated data sets are available from: 

at: http://qold.astro.utoronto.ca/conley/simple_cosfitter http://hdl.handle.net/1807/26549 

© 2012 RAS, MNRAS OOCfTpO] 



4 M.C. March et al. 




Figure 1. A simulated SNANA data set, comprising SNe from Low Z (red); SDSS (green); SNLS3 (gold) and HST (red). 



For more general cosmological parameter inference applica- 
tions, we are also interested in comparing the performance of the 
two methods on a composite 'cosmological' data set, since extract- 
ing good constraints on cosmological parameters from SNIa sur- 
veys requires the inclusion of both low-redshift and high-redshift 
samples. Since no survey currently covers both the low- and high- 
redshift parts of the Hubble diagram, several data sets are gener- 
ally considered together to span the full redshift range. In this pa- 
per we use the compilation suggested and supplied by the SNLS3 
team, which is described in |Guy et al.| ( |2010| >. In addition to the 
SNLS3 data, it is comprised of: various samples with z < 0.1; 
the SDSS survey JKessler et al.|2009a[ [Holtzman et al.|2008) for 
0.1 < z < 0.4; and high-redshift HST data ( |Riess & Strolger| 
|2007| >. Selection cuts, SALT-II lightcurve fitting and Malmquist 
corrections are made by the SNLS3 team and are already imple- 
mented in the supplied data files, as discussed in detail in |Perrett| 
[eTaLlpOTot . 



4 SIMULATED SUPERNOVAE DATA 

SNIa photometric data were simulated and fitted u sing the publicly 
available SNANA packag^jl Kessler et al. 2009b . First, data were 
simulated to match closely the SNLS3 data set i Guy et al.|2010) 
by using the SNLS3 co-added simulation library files (which are 
publicly available as part of the SNANA package), a coherent mag- 
nitude smearing of 0.12, and colour smearing. The colour smearing 



5 The SNANA package has generously been made available at: 
|http://sdssdp62.fnal.gov/sdsssn/SNANA-PUBLIC7| 



effect, or broad-band colour dispersion model, implemented in the 
data simulation is the EXPPOL model described by Fig. 8 of ( Guy 
|et al.|20f0), an d the simulated Malmquist bias is based on Fig. 14 
of |Perrett et al.| ( |2010[ >. In total 100 similar data sets of SNLS3 style 
SNIa were simulated. 

The SNANA SNIa data simulation is a two-stage process that 
mimics the real data collection and analysis process. The first stage 
is the simulation of photometric data in accordance with the charac- 
teristic instrument and survey properties of the SNSL3 survey using 
the SNLS3 simulation library files mentioned above. The second 
stage is the lightcurve fitting process in which the photometric data 
are fitted to SALT-II templates to give estimates of the SNIa ab- 
solute B-band magnitude rhs, lightcurve stretch xi and colour c. 
At this lightcurve fitting stage, basic cuts are made to discard SNIa 
with a low signal-to-noise ratio and/or too few observed epochs in 
sufficient bands. After the lightcurve fitting stage we make a red- 
shift dependent magnitude correction for the Malmquist bias; the 
correction is taken from a spline interpolation of table 4 in |Per-| 
|rett et al.] l |2010) . All selection cuts and Malmquist corrections take 
place prior to the cosmology inference step. 

In addition to simulating the SNLS3 single survey data sets, 
we also simulate combined 'cosmological' data sets made by sim- 
ulating individual LowZ, SDSS and HST samples which are gener- 
ated separately using SNANA and the appropriate simulation tem- 
plates. The LowZ sample SNIa were simulated based on the CFA3- 
KepplerCam lightcurves (Hicken et al. 2009 ; SDSS sample uses 
the S DSS 2005 templates (|Holtzman et al. |2008[ |Kessler et al] 
|2009a| |Lampeitl et al.|2009) and the HST sample is based on the 
Strolg er & Riess| i2006i templates. An example combined simu- 
lated data set is shown in Fig.[T| 
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ACDM 



SNLS3 only 



Combined sample 



Parameter 


BHM 


X 2 -method 


BHM 


X 2 -method 


a 


0.007 


0.009 


0.010 


0.0021 


P 


-0.096 


-0.085 


-0.029 


-0.075 




0.011 


-0.088 


-0.037 


-0.041 




0.091 


-0.062 


0.021 


0.0086 



Table 1. Bias on the estimators of the parameters of interest obtained from 
the two cosmological inference methods, for ACDMmodel, as a result of 
the analysis of 100 sets of SNSL3 only data, and 100 sets of 'cosmology' 
data sets. 



5 RESULTS FROM SIMULATED DATA 

In section [5T| we analyse both the single survey SNLS3 data sets, 
and the combined multi survey 'cosmology' data sets within the 
framework of the ACDM model in which non-zero curvature is al- 
lowed. In section [5^2| we further analyse the compiled 'cosmology' 
data sets within the framework of the flat toCDM model in which 
curvature is fixed at zero, but the dark energy equation of state, w 
is permitted to vary. 



5.1 ACDM analysis of SNLS3 and 'cosmological' samples 

In the ACDM analysis of simulated SNLS3 data alone, we find that 
both methods perform well, considering the difficulties that arise 
when attempting to obtain cosmological constraints from a survey 
that does not include a low-z sample to anchor the lower end of the 
Hubble diagram. 

Fig. [2] (top 4 panels) shows the sampling distributions of the 
estimators for the parameters of interest for the BHM (blue his- 
tograms) and the x 2 - me thod (green histograms), as implemented 
by the 'simple_cos_fitter'. We see that both methods recover simi- 
lar global SNIa parameters a, /3. More importantly, both methods 
recover the cosmological parameters fl m ,o and Qa,o, but with small 
biasses that differ between the methods. 

The biasses on the recovered parameter values for both meth- 
ods are listed in Table[T| Perhaps most notable, is that the recovered 
value of Qm.o in BHM is biassed slightly high, whereas that for the 
X 2 method is biassed somewhat low. Thus, when the two meth- 
ods are used to analyse the same data set, they can give discrepant 
values for Q m< o. Fig. [2] (middle 4 panels) shows that the average 
discrepancy in fi m ,o for the single survey SNLS3 data is ~ 0.1 and 
the maximum discrepancy can be up to ~ 0.2. From the bottom 4 
panels of Fig. [2] we see that in ~ 73% of trials the BHM provides 
an estimator for fi m ,o which is closer to the true value of Q m ,o than 
the estimator given by the \ 2 method. 

Analysis of the SNLS3 survey alone is useful for particular 
applications such as when used in conjunction with other non SNIa 
data sets as mentioned earlier. However, when the primary aim of 
the analysis is cosmological parameter inference, then several dif- 
ferent surveys are analysed together to span an appreciable red- 
shift range and form a 'cosmological' sample. In order to obtain 
constraints on the cosmological parameters, we analysed combined 
'cosmological' samples described in section|4]which span a broader 
redshift range. 

The results of these analyses are presented in Fig[3] The top 4 
panels show the cosmological parameter inference results when the 
SNLS3 SNIa are analysed jointly with the LowZ, SDSS and HST 
simulated samples. As can be seen by comparing the corresponding 
panels in Fig. [2] the width of the sampling distribution decreases 
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Figure 2. ACDM analysis of simulated SNLS3 data sets. Top 4 panels: 
sampling distributions derived from 100 sets of simulated data for the SNIa 
global parameters a, and the cosmological parameters f2 m o, o> m " 
ferred using the BHM (blue histograms) and the chi-square method as 
implemented by the 'simple_cos_fitter' code (green histogram). Blue and 
green vertical lines show the mean value of the estimator, solid red verti- 
cal lines show the value of the true (i.e. model input) parameter. Middle 4 
panels: histograms showing the raw difference in estimators between the 
BHM method and 'simple_cos_fitter' method, given by (?bhm — • ® x 2 ' 
torn 4 panels: the difference in accuracy between the two methods, given by 
T = "tmed^BHM - e tme| - \& x 2 - ©true]). Negative values of r indicate 
that the BHM estimator is closer to the true value than the simple_cos_fitter 
(i.e.x 2 ) estimator. 
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0.2 0.4 0.6 0.8 1 1.2 

n. 



ujCDM 
Combined sample 



Parameter 


BHM 


X 2 -method 


a 


0.0050 


0.0021 


P 


0.0063 


-0.0076 




-0.023 


-0.043 


W 


-0.050 


-0.034 



Table 2. Bias on the estimators of the parameters of interest for the toCDM 
model, obtained from the two cosmological inference methods applied to 
the 100 simulated sets of 'cosmological' samples. 



sample alone; whereas for the 'cosmology' sample the mean differ- 
ences between the estimators for fl m ,o and JIa.o decrease to 0.004 
and 0.012 respectively, as can be seen in the middle 4 panels of 



mean diff =0.0083 



mean diff =0.046 



£02 0.02 -0.2 0.2 



mean diff =0.004 
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mean diff =0.012 
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5.2 wCDM analysis of combined 'cosmological' sample 

As well as the standard ACDM model of the Universe, many theo- 
ries of dark energy have been put forward which have a dark energy 
equation of state such that w 7^ — 1 (for some examples of compre- 
hensi ve reviews see|Amendola & Tsujikawa|2010| |Frieman et al.| 
|2008|[Peebles & R atra 2003 j. The dark energy equation of state, w 
is highly degenerate with curvature, a degeneracy which cannot be 
broken with a geometric probe alone such as the SNIa. Hence we 
perform the cosmological parameter inference within the wCDM 
model in the context of a flat Universe for which flk,o = 0. 

The SNLS3 sample alone do not cover a broad enough redshift 
range to give meaningful constraints on w, hence we only present a 
cosmological parameter inference for the wCDM model using the 
combined 'cosmology' samples. The results of the wCDM analysis 
for the simulated 'cosmological' SNIa data sets for the BHM and 
\ 2 methods are presented in Fig|4]and Table|2] 




Figure 3. As for Fig. [2] but for the ACDM analysis of 100 simulations of 
the combined 'cosmology' data set. 



when the additional low and high redshift SNIa are included in the 
analysis. 

Increasing the redshift range of the SNIa sample also de- 
creases the discrepancy between the estimators for the cosmologi- 
cal parameters given by the two inference methods. From the mid- 
dle 4 panels of Fig. [2] the mean differences between the estimators 
for f2 m ,Q and £Ia,o are 0.099 and 0.15 respectively for the SNLS3 



6 RESULTS FROM REAL DATA 

We applied both parameter inference methods to the real SNLS3 
single survey data set, and the combined 'cosmological' data set 
described in section [3] for the ACDM model and wCDM model. 
The data sets supplied by the SNLS team are a linearly transformed 
version of the SALT-II parameters (Guy et al.|2010) , hence it is 
not meaningful to compare the transformed SNIa global parameters 
a, j3 with the corresponding parameters in our standard SALT-II. 



6.1 ACDM analysis of SNLS3 sample 

We present the cosmological parameter inference for the ACDM 
model using only SNLS3 data in Fig. [5] The upper plot in shows 
the 68.3% and 95.4% contours for the real SNLS3 only data set. 
Contours from the BHM are shown in blue, and contours from the 
X 2 method in green. The estimators for the parameters for both 
methods are the expectation values of the 1-D marginalised pos- 
teriors (BHM) or likelihoods (x 2 ), the estimators for the BHM are 
indicated with a blue star, and the estimators for the % 2 with a green 
star. Of note is the discrepancy of 2a in the inference of Q m> o and 
Qa,o, corresponding to a difference of 0.2 units of f2 m ,o- A dis- 
crepancy of this magnitude does fall within the expected range of 
mean differences (see Fig[2} although it does lie towards the tail of 
the mean-difference distribution. The lower panel of Fig. [5] shows 
an example analysis of a corresponding simulated SNLS3 only data 
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Figure 4. As for Fig. [2] but for the tuCDM analysis of 100 simulations of 
the combined 'cosmology' data set. 




simulated data, SNLS3 only 




Figure 5. Contour plots for ACDM analysis of real and simulated SNLS3 
data sets. Contours enclose 68.3% and 95.4% of the posterior mass or like- 
lihood for the BHM (blue) and x 2 (green) methods. Blue and green stars 
show the locations of the estimators for the BHM and \' 2 methods respec- 
tively. The upper plot shows the analysis of the real data, and the lower plot 
the simulated data. For the analysis of the simulated data, a red star indicates 
the location of the true model input parameters. 



6.2 ACDM analysis of combined 'cosmological' sample 

Including the additional high and low redshift SNIa that make up 
the 'cosmological' sample significantly reduces the discrepancy be- 
tween estimators for f2 m ,o and J1a,o obtained using the two differ- 
ent inference methods, as shown in Fig. [6] As expected, for the real 
data, increasing the redshift range of the data set greatly enhances 
the ability of the SNIa to constrain f2 m ,o and S7a,o- 

Similarly, for the simulated data, including the additional high 
and low redshift SNIa decreases the discrepancy between the esti- 
mators for the two methods, and increases the constraining power 
of the SNIa. Interestingly, for this particular realization of the simu- 
lated data, both methods give almost the same values for flm,o and 
Qa,o, which are yet la distant from the true values. There is scope 
for further investigation as to when the two methods converge, un- 
der what circumstances each method is more accurate, and in what 
limit the BHM reduces to the \ 2 approximation for parameter in- 
ference. 



set. Additionally, this lower plot includes a red star to indicate the 
location of the model input parameters from which the simulated 
data set was generated. 



6.3 wCDM analysis of combined 'cosmological' sample 

In Fig. [7] we present the analysis of the real 'cosmology' data set 
for the flat wCDM model (upper plot), and compare it with a cor- 
responding simulated data set (lower panel). The same simulated 
data set is used in the lower panels of both Fig. [6] and [7] The dis- 
crepancy of 0.2 units of w between the inferred values for the dark 
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real data, 'cosmology' sample 




real data, 'cosmology' sample 



simulated data, 'cosmology' sample 




Figure 6. As for Fig. [6] but for ACDM analysis of real and simulated com- 
bined 'cosmological' data sets. 



energy equation of state recovered for the real data set by the two 
inference methods is just within the expected range for the mean 
difference, as shown in Figj4] As previously, this particular realisa- 
tion of simulated data gives a very small discrepancy between the 
value of the estimators for the two methods. 



7 CONCLUSIONS 

Through the analysis of realistic simulated SNe data sets, we have 
established that the BHM and \ 2 cosmological parameter inference 
methods give different but comparable results when applied to the 
same data. Both methods suffer from small biasses in the recovery 
of cosmological parameters and the discrepancy between the two 
methods is greatest when only a single survey such as SNLS3 is 
used. In this case, we find that the BHM gives slightly less biassed 
results, particularly on the value of fi m ,n. Moreover, the biasses 
on Q,m,o are in opposite directions for the two methods, which an 
result in a ~ 2a discrepancy in its estimated value for any given re- 
alisation of the SNLS3-type data. Indeed, we find this to be the case 
for the real SNLS3 data set. The discrepancy between the methods 
diminishes, however, as the redshift range of the data set increases. 
As more higher and lower redshift SNIa are added to the sample, 
the two methods begin to converge on their estimate for the cosmo- 
logical parameters of interest. 

We note that we have investigated the difference between the 
parameter inferences obtained for two methods for a given pre- 
selected, pre-corrected data set. One cannot over-emphasise, how- 
ever, the importance of the preceding selection cuts and Malmquist 
bias corrections for obtaining accurate estimates of the underlying 
cosmological parameters. Current SNIa data sets have been spec- 
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Figure 7. As for Fig. [6] but for miCDM analysis of real and simulated com- 
bined 'cosmological' data sets. 



troscopically selected, which ensures a high degree of purity of 
sample, but future large SN scale surveys such as the Dark Energy 
Survey will rely heavily on photometric classification 1 B ernstein] 
|et al.|2012) . For a discussion of how photometric selection methods 
affect the cosmological parameter inference independently of how 
the parameter inference step is performed, see Sako et al.|p0TT) . 

Finally, we also point out that our investigation has been car- 
ried out specifically in the context of the SALT-II fitted SNIa 
data. We believe this analysis to be of use to the community, as 
the SALT-II light curve fitter is one of the most widely used 
(along with MLCS) and many current surveys have released their 
SNIa data in this SALT-II fitted format. We look forward to the 
future as increasingly sophisticated light curve fitting techniques 
(e.g jMandel et al.|l 2009}) and cosmological parameter inference 
methods (e.g. |Shafieloo et al.|(20"T2) ; |Seikel et al. 1(20 12) ) gradu- 
ally supersede current methods, but in the meantime we offer this 
study into the comparative performance of two different cosmo- 
logical parameter inference techniques that are currently used in 
conjunction with the SALT-II light curve fitter. 
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APPENDIX A: FORM OF THE BHM LIKELIHOOD FUNCTION 

For each SN, we seek the likelihood \\2) of the input data given the parameters of our model, namely 

Pr(m.B,j, Xi,i, Cj, Zi\V, a, f3, cr mt , d, <r Zti ), (Al) 

we 



2.2 



where, for completeness, we have included the dependence on the assumed known uncertaintes Ct and a z j. As discussed in Section ; 
compute this likelihood by first introducing the hidden variables Mi, xi,u c% and Zi, which are, respectively, the true (unknown) values of its 
absolute B-band magnitude, stretch and colour corrections, and redshift; these are then assigned priors and marginalised over to obtain the 
likelihood (AT}. 

For the sake of brevity, we denote the (global) model parameters in ( Al i that we wish to constrain by cj) = ', a, /3, <7i nt } and those 
assumed known (and different for each SN) by ipi = {Ci, o" 2 ,i}. Thus, introducing the hidden variables Mi, xi,i, d and Zi, the likelihood 
( |A 1 [ > can be written as 



Pi(m Bii , xi,i,Ci, Zi\(j>, ip) = J dMi dxi ti dd dz r Prfm^, x M , Cj, Zi\(p, ip, Mi, x 1 ^,c i ,z i ) Pr(Mi,Xi, a, Zi|<7 ml ). 



(A2) 



Assuming that the measured redshift Zi is independent of m Bi , Xi,i and c\, and, similarly, that the true redshift Zi is independent of Mi, x%, 
d, one may write 

1W&**x.u*i,*i\+,+) = fd« Pr^l^Pr^ 

(A3) 

where Pr(zj) is the prior on the true SN redshift, and the prior Pr(Mj, xi,i, d\o~- mt ) can itself be expanded as 

Pr(Mj, xi,i, Ci\<T- mt ) = J dM dx, dR x dc» dR c Pr(Mi,x 1: i,d\Mo,a mt ,x,,R x ,c,,R c )Pr(M ,x,,R x ,c,,R c \a mt ), (A4) 

in which we have introduced the nuisance hyperparameters Mo, £*, R x , c* and R c associated with the SN population and described below. 
Equations |A3} and \AA\ form the basis for the Bayesian hierarchical model of March et al. (20lT}. 

To proceed further, one first assumes that both of the joint prior distributions in the integrand of \AA) are separable, as follows: 

Pr(Mi,xi,i,Ci\M ,(T m ,x*,R*,c*,R*) = Pr(Mi\M , CTmt) Pr(a;i,i|a;„ R x ) Pr(ci|c*, R c ), (A5) 
Pr(Mo,x», J R»,c < ,,fl < ,|cr inl ) = Pr(M )Pr(a;*)Pr(i^)Pr(c*)Pr(JZc). (A6) 

One then assigns a form for the prior distribution of each of the hidden parameters Mi, X\,u Ci, Zi and nuisance hyperparameters Mo, 
x„, R x , c*, R c . These are taken to be: Pr(Mi\M , cr inl ) = Af(M , af nt ), Pr(xi,i|x» , R x ) = M{x t ,R 2 x ), Pr(ci|c*, R c ) = A[(c*,r£), 
Pr( 2l ) = 1, Pr(Mo) = Af(Mo,<r 2 Mo ), Pr(x«) = A^(0,^J, Pr(c) = N{0,o 2 c ,), Pr(R x ) = 1/7?, and Pr(i? c ) = 1/R C , where one 
assumes Mq = —19.3 mag, (Jm = 2.0 mag, a Xr — 1 and a Ct — 1. 

The only remaining probability distributions required to evaluate i A3 i are Pr(zi\zi, a z ,i) and Pr(fh B { , xi,i, Ci\(f), tf>, Mi, x\ t i,Ci,zC). 
The former is given simply by Px(ii\zi, (J z> i) — Af(zi,a 2 ti ) and the latter is the multivariate Gaussian 

Pr(rh Bti , X!,i,Ci\4>, i>, Mi,xi,i, Cj, Zi) = \2n6 t \~ 1/2 exp - vfCf 1 ^ - u)j , (A7) 

where v — [m B >it xx,i, q] 4 , v = [fi(zi,C) + Mi — ax\ t i + f3d,x\^,Ci^ and )j,(zi,C) is the predicted distance modulus given by j^jl. 

All the necessary integrals in {A3} and \A4\ a re Gaussian, except those over R x and R c . Thus, |March et al. | < |20 1 1 j > integrate analytically 
to obtain a final expression for the likelihood \Al \ in terms of an integral over only R x and R c . Since this expression is rather complicated, 
and requires the definition of a number of covariance matrices, we do not reproduce it here. In any case, the last two integrations over R x and 
R c cannot be performed analytically, and so these variables are added to the parameters of interest cf> and sampled, in order to marginalise 
over them numerically. It is worth noting that, in principle, all the integrals in {A3} and ( |A4| > could be performed numerically by sampling 
from the full set of hidden parameters Mi, xi,i, d, Zi and nuisance hyper parameters Mo, x,, R x , c, R c (in addition to the parameters 
of interest </>), and marginalising over them. Although this would increase somewhat the dimensionality of the space from which to obtain 
samples, it would also allow trivially for more realistic priors on the hidden and nuisance parameters than the simple separable Gaussian 
forms assumed above. We will investigate this possibility in a future publication. 
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